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The  regenerative  method  for  estimating  steady-state  parameters  is  one  of  the 
basic  methods  in  the  simulation  literature.  This  method  depends  on  central  limit 
theorems  for  regenerative  processes  and  weakly  consistent  estimates  for  the  variance 
constants  arising  in  the  central  limit  theorem.  A  weak  sufficient  (and  probably 
necessary)  condition  for  both  the  central  limit  theorems  and  consistent  estimates  is 
given.  Several  references  have  claimed  (without  proof)  strong  consistency  of  the 
variance  estimates  under  our  condition.  This  claim  seems  to  us  unjustified  and  we  hope 
this  note  helps  clarify  the  situation.  Also  discussed  is  the  relationship  between 
conditions  for  the  validity  of  the  regenerative  method  and  those  for  the  validity  of  the 
standardized  time  series  methods. 
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1 .  Introduction. 

The  regenerative  method  (RM)  for  estimating  steady-state  parameters  via 
simulation  has  been  widely  studied;  cf.  Bratley,  Fox,  and  Schrage  (1987),  p.  95,  Crane 
and  Lemoine  (1977),  and  Law  and  Kelton  (1991),  p.  557.  Our  goal  in  this  paper  is  to 
develop  the  weakest  known  condition  under  which  the  RM  is  valid.  [This  condition  is 
probably  necessary,  as  well  as  sufficient.]  This  condition  is  of  interest  since  a  number  of 
errors  on  this  subject  have  appeared  in  the  literature.  Furthermore,  since  the  RM  is 
perhaps  the  cleanest  setting  for  simulation  output  analysis,  it  is  important  to  have  a 
good  understanding  of  the  required  condition.  This  paper  also  discusses  the  relationship 
between  conditions  for  the  validity  of  the  regenerative  methods  and  those  for  the 
validity  of  the  standardized  times  series  methods  (STSM). 

Let  X  =  (A'(i):t  >  0)  be  a  (possibly  delayed)  regenerative  process  on  state  space 
S  with  regeneration  times  T’(— 1)  =  0  <  ^(O)  <  T’(l)  <  •••.  Denote  the  regenerative  cycle 
lengths  by  =  r(n)  —  r(n  —  1),  n  >  0.  Let  f:S  — >  R  be  a  given  measurable  function 
and  define  the  sequence  of  random  variables 

i'„(/)=r"^  ms)}ds,  n>0. 

JT(n-l) 

Often  we  abbreviate  y„(f)  as  Y„,  when  no  ambiguity  arises.  Throughout  this  paper  we 
assume  that  the  regenerative  process  X  is  positive  recurrent,  so  that  <  oo.  The 
condition  that  follows  is  the  one  we  use  to  guarantee  the  validity  of  the  RM. 


Condition  A. 

There  exists  a  finite  constant  a  such  that  £^[1^1  —  0X11  =  0  and 
0  <  E[{Yi  -  aTi)2]  <  oo. 

Let  Z„  =  Kn  —  Qr„,  n  >  1.  The  regenerative  property  of  X  implies  that  the 
sequence  (Z„:n>l)  is  independent  and  identically  distributed  (i.i.d.).  Condition  A 
implies  that  E\Zx\  <  oo,  f^lVij  <  oo,  and  o  =  EYifEr^. 

Two  point  estimators  for  o  arise  in  the  RM.  The  first,  a(t),  is  based  on  a 
simulation  from  time  0  to  t.  The  second,  a„,  is  based  on  a  simulation  of  n  regenerative 
cycles.  These  estimators  are  defined  as 


and 


a(<)  =  (-■  f/lA-WliJj,  OO, 

^  n/’^n» 


where  The  fact  that  a(t)  is  strongly  consistent  for  a 

when  .ElVil  <  oo  and  Eti  <  oo  (converges  to  a  a.s.  as  f  — ►  oo)  is  well  known  in  the 
regenerative  process  literature;  cf.  Chung  (1960),  p.  87,  for  a  proof  in  the  Markov  chain 
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case.  Under  the  S2nne  condition  a„  is  strongly  consistent  for  a  by  the  strong  law  of  large 
numbers  for  i.i.d.  random  variables  (r.v.). 

The  goal  of  the  RM  is  to  produce  asymptotically  valid  confidence  intervals  for  q 
as  the  length  of  the  simulation  becomes  large  (<  -+  oo  or  n  — >  oo).  This  requires  the 
following  central  limit  theorems  (c.l.t.)  for  both  a{t)  and  a„: 


(1.1)  Theorem.  If  condition  A  holds,  then 

(1.2)  t^^^[a(t)  —  a]  =»  <riN{0, 1)  as  t  oo, 

(1.3)  — a]  =>  <r2iV(0, 1)  os  n  — >  oo, 


where  =>  denotes  weak  convergence,  iV(0, 1)  is  a  normal  r.v.  mean  0  variance  1, 
(T?  =  EZIIEti,  and  al  =  EZ\l{ET^f. 

Again,  this  theorem  is  well  established;  cf.  Chung  (1960),  p.  94.  To  complete  the 
establishment  of  asymptotic  confidence  intervals  for  q  we  need  weakly  consistent 
estimators  v{t)  and  for  al  and  al  respectively.  Given  such  estimators,  it  follows  from 
Theorem  1.1  and  the  continuous  mapping  theorem  (Billingsley  (1968),  p.  30)  that  the 


intervals 

(1.4) 

(1.5) 

L  a  + 

(_“"  „l/2  ’ 

are  asymptotic  100(1 

—  ^)%  confidence  intervals 

for  a,  where 

P(jV(0, 1)  <  z(^)]  =  1  —  ^/2-  In  Section  2  we  show  that  condition  A  is  sufficient  to 
guarantee  the  existence  of  weakly  consistent  estimators  for  aj  and  al-  We  note  that 
Condition  A  does  not  imply  that  EYi{f)  <  oo  and  Erj  <  oo,  so  that  standard 
arguments  based  on  the  law  of  large  numbers  do  not  apply. 
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2.  Consistency  of  Regenerative  Variance  Estimators 

The  two  variance  estimators  we  consider  for  al  and  <72  respectively  are 


N{t) 

v{t)  =  r^  E 


1=1 


t  >  0 


and 


»=i _ 


n  >  1 


where  N{t)  =  sup{n  >  — 1  :r(n)  <  t},  the  number  of  completed  regenerative  cycles  in  the 
interval  [0,<].  Our  main  result,  contained  in  the  next  theorem,  is  to  show  weak 
consistency  of  v(t)  and  t;„  under  the  same  condition  as  that  required  for  the  c.l.i.’s  (see 
Theorem  1.1). 


(2.1)  Theorem.  If  condition  A  holds,  then 

(2.2)  t;(<)  =►  as  t  00 

and 

(2.3)  a\  09  n  — ♦  00. 


Proof.  We  shall  only  prove  (2.2)  here,  as  the  proof  for  (2.3)  is  similar.  First  we  rewrite 
t;(f)  as 


(2.4) 


^(0 

»(«)  =  <-■  E(Ki-ar,-(a(<)-o)T,P 
i=l 

Nit)  N{t) 

=  r»E^?-2r*E^.r,(a(f)-a) 

i=l  isl 

N{t) 

+  f->(a(()-«)’  E  T?. 

1  =  1 


The  first  term  on  the  right-hand  side  (r.h.s.)  of  (2.4)  converges  to  cr?  a.s.  by  the  strong 
laws  for  i.i.d.  partial  sums  and  for  renewal  processes.  Hence  we  need  to  show  that  terms 
two  and  three  on  the  r.h.s.  of  (2.4)  converge  weakly  to  zero,  and  then  apply  the 
“Converging  Together”  theorem;  cf.  Billingsley  (1968),  p.  25.  For  term  two  we  know 
that  t^^^(a(t)  —  a)  =►  <TiiV’(0, 1).  So  it  suffices  to  show  that 

3^(») 

(2.5)  E  0  a-s-  as  t  ->  00 

i=l 


in  order  to  conclude  that  the  second  term  converges  weakly  to  0.  Since  EZl  <  00  by 
assumption,  Z\ln  — »  0  a.s.  by  the  Borel-Cantelli  lemma;  cf.,  Chung  (1968)  and  apply 
Theorem  3.2.1,  4.2.1,  and  4.2.2.  This  in  turn  implies  that  -»  0  a.s., 

0  a.s. 


max 


0  a.s.,  and  max  |Zfc|/f*^* 
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Now  observe  that 


3N{t)  _3/V(t) 

\t~'^  E  z,r,\  <  n  ^  IZ.T.I 

t=l  i=l 

-i  N{t) 

<  <2max  iZfc|)-(r‘ E  r.). 


As  shown  above  the  first  term  on  the  r.h.s.  above  converges  to  0  a.s.,  while  the  second 
term  converges  a.s.  to  1  by  the  strong  laws  used  above.  For  the  third  term  on  the  r.h.s. 
of  (2.4),  we  note  that  —  a)*  =^>’  <7iAr(0, 1)^  from  (1.2).  Thus  it  suffices  to  show 

that 


N{t) 

(2.6)  t  ^  E  "T?  — ♦  0  a.s.  as  t  —*  oo. 

1=1 

Since  Et^  <  oo  by  assumption,  the  same  Borel-Cantelli  argument  used  above 

shows  that  majc  T^lt  —*  0  a.s. 
i<fc<yv{t) 

Thus 


N(t) 

i=l 


f  <  (/“*  max  Tl 


,A^(0 

k=l 


) 


0  a.s. 


establishing  (2.6).  Using  these  results  in  conjunction  with  (2.4)  shows  that  v(t)  =>  aj.  I 

There  has  been  the  claim  in  the  simulation  literature  that  Condition  A  implies 
strong  consistency  of  t;(t)  and  cf.  Bratley,  Fox,  and  Schrage  (1987),  p.  118-119; 
Crane  and  Lemoine  (1977),  p.  42;  Law  and  Kelton  (1991),  p.  559;  and  Shedler  (1987), 
p.  29.  No  proof  of  this  claim  has  been  given,  and  we  suspect  that  it  is  not  true  based  on 
the  argument  required  to  prove  Theorem  2.1.  Certainly  the  claim  is  true  under  the 
added  condition  EtI  <  oo,  which  may  be  what  was  intended  in  the  references  above. 

The  airgument  developed  above  also  establishes  the  weak  consistency  of  v„  for  the 
general  ratio  estimation  problem  of  the  form  a  =  EYilEry  Here  we  assume  that  the 
pairs  >  1}  are  i.i.d.,  that  E\ti\  <  oo,  there  exists  a  finite  constant  a  such  that 

E\Yy—oiT^  =  Q^  and  £[(1^1  —  aT^)^]  <  oo.  Confidence  intervals  for  a  can  now  be 
constructed  as  was  done  in  the  equation  (1.5). 


3.  CondHions  for  Standardizod  Timo  Sorios  Mothod 

There  are  two  principal  approaches  for  estimating  a  steady-state  parameter  from 
a  single  simulation  run.  The  RM  is  an  example  of  the  first  approach  in  which  we2dcly 
consistent  estimation  of  the  variance  constant  {ai  or  al  in  (1.2)  and  (1.3))  is  required. 
Other  examples  of  this  approach  arc  the  spectral  and  autoregressive  methods.  The 
second  approach,  proposed  by  Schruben  (1983),  are  the  standardized  time  series  method 
(STSM).  In  this  approach  the  variance  constant  is  “canceled  out”  in  a  manner 
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reminiscent  of  the  t-statistic.  The  popular  batch  means  method  is  a  special  case  of  the 
STSM.  The  starting  point  for  the  STSM  is  the  existence  of  a  functional  central  limit 
theorem  (f.c.l.t.);  see  Glynn  and  Iglehart  (1990)  for  this  development. 

To  discuss  the  f.c.l.t.  we  introduce  the  random  functions 

=  f[X{s)]ds 
■'0 

for  n  >  1  and  t  >  0,  where  X  =  (X(t):<  >  0)  is  the  regenerative  process  introduced  in 
Section  1.  Sample  functions  of  X„(  • )  lie  in  the  space  C[0,oo)  of  real- valued  continuous 
functions  on  [0,oo).  Necessary  and  sufficient  conditions  for  a  f.c.l.t.  to  hold  for  X„  were 
recently  obtained  by  Glynn  and  Whitt  (1991).  To  state  this  result  we  define  the 
sequence  of  i.i.d.  r.v.’s 

W„(/)  =  sup  |f/[X(r„_,  +  u)du|,  n>l. 

The  result  of  Glynn  and  Whitt  is 

(3.1)  Theorem.  There  exist  finite-valued  deterministic  constants  a  and  a  such  that  => 
(tB  in  C  [0,  oo)  if  and  only  if 

(3.2)  -<.))>]  <oo 
and 

(3.3)  n*P(W,(/  -  a)  >  n]  0  n  ^  oo, 

1 

where  y„(f)  =  n5[A’„(f)  —  at]  and  B  is  standard  Brownian  motion.  In  case  conditions 
(3.2)  and  (3.3)  hold,  a  =  EYy{f)IET^  ando^  =  E[{Yi{f  -  a))’]/Pri. 

Note  that  Yi{f  —  a)  =  Z|.  Observe  that  condition  (3.3)  is  an  aulditionaJ  condition 
needed  for  the  f.c.l.t.  that  is  not  needed  for  the  c.l.t.  Here  is  an  example  of  a 
regenerative  process  that  satisfies  the  c.l.t.  but  not  the  f.c.l.t. 

Let  (CJ^„:n>0)  and  (V„:n>0)  be  two  sequences  of  real- valued  r.v.’s  satisfying 
the  following  conditions: 

(3.4)  >  0}  is  a  sequence  of  independent  pairs, 

(3.5)  (f/„:n>0)  is  an  identically  distributed  sequence  with  EUi=0  and 
EUi  =  <7*  <  oo;  and 

(3.6)  (V^n-^^0)  is  ^  identically  distributed  sequence  with  P|Vx|<oo  and 
E\V^ff'^  =  oo. 
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Now  let  r(0)  =  0  and  T{ti)  =  2n  for  n  >  1;  all  regenerative  cycles  au-e  of  length  2.  For 
n  >  0,  set  X^n  =  U„  +  V„,  Xin+i  =  -V’„,  and  f{x)  =  x.  Finally,  set  X{t)  =  for 
t  >  0.  Observe  that  X  =  (X(<):<  >  0)  is  a  regenerative  process  with  Q  =  0, 

Z„  =  U„_i  and  W„  =  max{|t7„_i  +  V„_il,  +  2V„_i\}.  If  we  can  exhibit  Uq  and  Vq 
such  that  EWi^^  =  oo,  then  ^  >  n)  =  oo  and  (3.3)  will  be  violated. 

Note  that  EW\>  E\Uq-\-Vq^.  Now  take  Uq  and  Vq  independent  with 
—  ~  ~  5  ^ind  P{Vo  “  for  n  =  1,2,...  and  a  positive 

constant  c.  It  is  easy  to  check  that  (3.3)  is  not  valid. 

The  example  above  shows  that  the  regenerative  c.l.t.  can  hold  without  the  f.c.l.t. 
holding;  this  result  is  mentioned  in  Bratley,  Fox,  and  Schrage  (1987),  p.  121.  Thus  the 
RM  is  valid  for  cases  in  which  the  f.I.c.t  leading  to  the  STSM  is  not.  In  this  sense  the 
RM  has  a  larger  domain  of  applicability  than  does  the  STSM. 

Of  course,  it  is  also  the  case  that  the  f.c.l.t  (and  hence  the  STSM)  can  hold  for  a 
non-regenerative  stochastic  process  for  which  the  RM  is  no  longer  valid.  Hence,  neither 
the  class  of  stochastic  processes  for  which  the  RM  holds  nor  the  class  for  which  the 
STSM  holds  contains  the  other. 
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Abstract 

The  regeoerative  method  for  estimating  steady-state  parameters  is  one  of  the 
basic  methods  in  the  simulation  literature.  This  method  depends  on  central  limit 
theorems  for  regenerative  processes  and  weakly  consistent  estimates  for  the  variance 
constants  arising  in  the  central  limit  theorem.  A  weak  sufficient  (and  probably 
necessary)  condition  for  both  the  central  limit  theorems  and  consistent  estimates  is 
given.  Several  references  have  claimed  (without  proof)  strong  consistency  of  the 
variance  estimates  imder  our  condition.  This  claim  seems  to  us  unjustified  and  we  hope 
this  note  helps  clarify  the  situation.  Also  disctissed  is  the  relationship  between 
conditions  for  the  validity  of  the  regenerative  method  and  those  for  the  validity  of  the 
standardized  time  series  methods. 


MCUMTT  CUkSSIFICATIO*  OF  TMIl  FAOt 


